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MEASUREMENT AND SIGNATURE INTELLIGENCE 
ANALYSIS AND REDUCTION TECHNIQUE 

[01] This application is a continuation-in-part of common-owned, co-pending U.S. 
Application No. 10/269,818 filed on October 11, 2002, naming Francis Robert Cirillo and 
Paul Leonard Poehler as inventors and claiming priority to provisional U.S. Application 
No. 60/392,316 ("Measurement and Signature Intelligence Analysis and Reduction 
Technique"), filed June 28, 2002. 

Field of the Invention 

[02] The present invention relates to compressing and decompressing data such as synthetic 
aperture radar data. 

Background of the Invention 

[03] Compression of Synthetic Aperture Radar (SAR) data may require that both magnitude 
and phase information be preserved. Figure 1 shows data processing of synthetic 
aperture radar data according to prior art. Synthetic aperture radar data 102 are typically 
collected in analog format by an antenna 101 and is converted to digital format through 
an Analog-to-Digital (A/D) converter 103. The raw, unprocessed data are referred to as 
Video Phase History (VPH) data 104, and comprise two components: In-phase (I) and 
Quadrature (Q). Video phase history data 104 having multiple components, such as I and 
Q, are typically referred as complex SAR data. Complex SAR data are essential for the 
generation of complex SAR applications products such as interferograms, polarimetry, 
and coherent change detection, in which a plurality of such images must be processed and 
compared. 

[04] Video phase history data 104 are then passed through a Phase History Processor (PHP) 
105 where data 104 are focused in both range (corresponding to a range focusing 
apparatus 107) and azimuth (corresponding to an azimuth focusing apparatus 109). The 
output of phase history processor 105 is referred to as Single Look Complex (SLC) data 
1 10. A detection function 1 1 1 processes SLC data 1 10 to form a detected image 1 12. 
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Existing complex SAR sensors collect increasingly large amounts of data. Processing the 
complex data information and generating resultant imagery products may utilize four to 
eight times the memory storage and bandwidth that is required for the detected data 
(I&Q). In fact, some studies suggest exponential growth in associated data throughput 
over the next decade. However, sensors are typically associated with on-board processors 
that have limited processing and storage capabilities. Moreover, collected data are often 
transmitted to ground stations over a radio channel having a limited frequency 
bandwidth. Consequently, collected data may require compression in order to store or 
transmit collected data within resource capabilities of data collecting apparatus. Also, a 
SAR compression algorithm should be robust enough to compress both VPH data 104 
and SLC SAR data 110, should produce visually near-lossless magnitude image, and 
should cause minimal degradation in resultant products 112. 

Several compression algorithms have been proposed to compress SAR data. However, 
while such compression algorithms generally work quite well for magnitude imagery, the 
compression algorithms may not efficiently compress phase information. Moreover, the 
phase component may be more important in carrying information about a SAR signal 
than the magnitude component. With SAR data 102, compression algorithms typically do 
not achieve compression ratios of more than ten to one without significant degradation of 
the phase information. Because many of the compression algorithms are typically 
designed for Electro/Optical (EO) imagery, the compression algorithms rely on high local 
data correlation to achieve good compression results and typically discard phase data 
prior to compression. Table 1 lists several compression algorithms discussed in the 
literature and provide a brief description of each. 
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Table 1 : Popular Alternative SAR Data Compression Algorithms 


Compression Algorithm 


Description 


Block Adaptive Quantization (BAQ) 


Choice of onboard data compression 
methods due to simplicity in coding and 
decoding hardware. Low compression 
ratios achieved (< 4:1). 


Vector Quantization (V Q) 


Codebook created assigning a number for a 
sequence of pixels. Awkward 
implementation since considerable 
complexity required in codebook 
formulation. 


Block Adaptive Vector Quantization 
(BAVQ) 


Consists of first compressing data with 
BAQ and then following up with VQ. 
Similar to BAQ. 


Karhunen-Loeve Transform (KLT) 


Statistically optimal transform for 
providing uncorrelated coefficients; 
however, computational cost is large. 


rast rouner iransiorm r>AQ (rr 1- 
BAQ) 


2-D Fast Fourier Transform (FFT) 
performed on raw SAR data. Before raw 
data is transformed, dynamic range for 
each block is decreased using a BAQ. 


uniiorm sampled Quantization (U5>Q) 


Emphasizes phase accuracy of selected 
points. 


FIpyiHIp RAO fFRAOY 


r>asea on minimizing mean square error 
between original and reconstructed data. 


Trellis-Coded Quantization (TCQ) 


Unique quantizer optimization design. 
Techniques provide superior signal to noise 
ratio (SNR) performance to BAQ and VQ 
for SAR. 


Block Adaptive Scalar Quantization 
(BSAQ) 


BSAQ's adaptive technique provides some 
performance improvement. 



Existing optical algorithms are inadequate for compressing complex multi-dimensional 
data, such as SAR data compression. For example with optical imagery, because of a 
human eyesight's natural high frequency roll-off, the high frequencies play a less 
important role than low frequencies. Also, optical imagery has high local correlation and 
the magnitude component is typically more important than the phase component. 
However, such characteristics may not be applicable to complex multi-dimensional data. 
Consequently, a method and apparatus that provides a large degree of compression 
without a significant degradation of the processed signal are beneficial in advancing the 
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art in storing and transmitting complex multi-dimensional data. Furthermore, the quality 
of the processed complex multi-dimensional data is not typically visually assessable. 
Thus, a means for evaluating the effects of compression on the resulting processed signal 
is beneficial to adjusting and to evaluating the compression process. 

Brief Summary of the Invention 

[08] The present invention provides methods and apparatus for compressing data comprising 
an In-phase (I) component and a Quadrature (Q) component. The compressed data may 
be saved into a memory or may be transmitted to a remote location for subsequent 
processing or storage. Statistical characteristics of the data are utilized to convert the data 
into a form that requires a reduced number of bits in accordance with its statistical 
characteristics. The data may be further compressed by transforming the data, as with a 
discrete cosine transform, and by modifying the transformed data in accordance with a 
quantization conversion table that is selected using a data type associated with the data. 
Additionally, a degree of redundancy may be removed from the processed data with an 
encoder. Subsequent processing of the compressed data may decompress the compressed 
data in order to approximate the original data by reversing the process for compressing 
the data with corresponding inverse operations. 

[09] In a first embodiment of the invention, data are compressed with an apparatus comprising 
a preprocessor, a transform module, a quantizer, an encoder, and a post-processor. The 
preprocessor separates the data into an I component and a Q component and bins each 
component according to statistical characteristics of the data. The transform module 
transforms the processed data into a discrete cosine transform that is quantized by the 
quantizer using a selected quantization conversion table. The encoder partially removes 
redundancy from the output of the quantizer using Huffman coding. The resulting data 
can be formatted by a post-processor for storage or transmittal. With a second 
embodiment, the preprocessor converts the I and Q components into amplitude and phase 
components and forms converted I and Q components. 
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[10] Variations of the embodiment may use a subset of the apparatus modules of the first or 
the second embodiment. In a variation of the embodiment, the apparatus comprises a 
preprocessor, a transform module, and a quantizer. 

[11] With another embodiment of the invention, interleaved I and Q components of SAR data 
can be processed rather than separating the components before processing the data. Thus, 
one is not constrained to separately compress and decompress the I and Q data. With the 
processing of interleaved I and Q data, one may assume that the statistical characteristics 
are the same, in which a deviation from this assumption may result in a reduced 
compression ratio. Moreover, the processing of interleaved data is applicable to data that 
are characterized by one or more dimensions. 

[12] With another embodiment of the invention, the data type being processed for 
compression and decompression is determined. With the compression process, the 
preprocessor interacts with the quantizer. The preprocessor provides metadata to the 
quantizer so that the quantizer can retrieve the appropriate quantization table from a 
knowledge database. The metadata may include statistical characteristics of the data 
being processed such as the mean, the standard deviation, and the maximum/minimum 
values. This aspect of the invention also supports a training mode, in which the quantizer 
informs the preprocessor so that a new data type can be specified. 

Brief Description of the Drawings 

[13] A more complete understanding of the present invention and the advantages thereof may 
be acquired by referring to the following description in consideration of the 
accompanying drawings, in which like reference numbers indicate like features and 
wherein: 

[14] Figure 1 shows data processing of synthetic aperture radar data according to prior art; 

[15] Figure 2 shows an apparatus for compressing data in accordance with an embodiment of 
the invention; 
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[16] Figure 3 shows a preprocessor apparatus for preprocessing a complex image in 
accordance with an embodiment of the invention; 

[17] Figure 4A shows a process for binning data associated with a complex image in 
accordance with an embodiment of the invention; 

[18] Figure 4B shows a process for truncating magnitude and phase components of a complex 
image in accordance with an embodiment of the invention; 

[19] Figure 5 shows probability density functions that are associated with In-phase (I) and 
Quadrature (Q) components of exemplary synthetic aperture radar (SAR) data; 

[20] Figure 6 shows Root Mean Square Error (RMSE) values that are associated with 
magnitude and phase data for processed signal data as shown in Figure 2 in accordance 
with an embodiment of the invention; 

[21] Figure 7 shows a partitioning of complex image data in order to obtain Discrete Cosine 
Transform (DCT) in accordance with an embodiment of the invention; 

[22] Figure 8 shows an apparatus for quantizing Discrete Cosine Transform (DCT) data in 
accordance with an embodiment of the invention; 

[23] Figure 9 shows a representative histogram for a low order Discrete Cosine Transform 
(DCT) coefficient in accordance with an embodiment of the invention; 

[24] Figure 10 shows a representative histogram for a high order Discrete Cosine Transform 
(DCT) coefficient in accordance with an embodiment of the invention; 

[25] Figure 1 1 shows a heuristic process for determining a quantization matrix according to an 
embodiment of the invention; 

[26] Figure 12 shows an apparatus for decompressing data in accordance with an embodiment 
of the invention; 
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[27] Figure 13 shows an architecture for processing synthetic aperture radar data in which 
components are split in accordance with an embodiment of the invention; 

[28] Figure 14 shows a data stream comprising interleaved components in accordance with an 
embodiment of the invention; 

[29] Figure 15 shows splitting of interleaved components into constituent components in 
accordance with an embodiment of the invention; 

[30] Figure 16 shows an architecture for processing synthetic aperture data in which 
components are interleaved in accordance with an embodiment of the invention; 

[31] Figure 17 shows a second apparatus for quantizing Discrete Cosine Transform (DCT) 
data in accordance with an embodiment of the invention; and 

[32] Figure 1 8 shows a flow diagram for processing data header information to determine a 
data type in accordance with an embodiment of the invention. 

Detailed Description of the Invention (First-Generation Embodiments) 

[33] In the following description of the various embodiments, reference is made to the 
accompanying drawings which form a part hereof, and in which is shown by way of 
illustration various embodiments in which the invention may be practiced. It is to be 
understood that other embodiments may be utilized and structural and functional 
modifications may be made without departing from the scope of the present invention. 

[34] Figure 2 shows an apparatus 200 for compressing Synthetic Aperture Radar (SAR) data 
202 in accordance with an embodiment of the invention. Synthetic Aperture Radar (SAR) 
data 202 can be compressed by apparatus 200 from Video Phase History (VPH) data 
format 104 or from a processed version typically referred as a single look complex SLC 
format 110. There are advantages and disadvantages associated with each format. VPH 
data 104 is available almost immediately, but is highly uncorrected. Single look 
complex SLC data 110 exhibits some local correlation. SLC data 110 may yield slightly 
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better compression results than with VPH data 104, but SLC 1 10 data are only available 
after processing has occurred. 

[35] Other embodiments of the invention may support other applications of complex 
multidimensional data, including weather data, oil and gas exploration data, 
encrypted/decrypted data, medical archival of MRI/CTI and three dimensional 
sonograms, digital video signals, and modem applications. 

[36] Referring again to Figure 2, apparatus 200 comprises a preprocessor 201, a transform 
module 203, a quantizer 205, an encoder 207, and a post-processor 209 in order to 
provide compressed data 212. SAR data 202 may comprise SAR pixel data that may be 
provided in the form of two floating-point numbers representing In-phase (I) and 
Quadrature (Q) components. (SAR data 202 may be considered as being "received" even 
though the data may not be received from a radio receiver but obtained from a memory 
that stores the data.) Preprocessor 201 may convert the I and Q components to Magnitude 
(M) and Phase ((p) components in accordance with a second embodiment as will be 
discussed in the context of Figure 4B. Additionally, preprocessor 201 may convert the I 
and Q components into magnitude and phase components to facilitate viewing SAR data 
202. The magnitude and the phase components may be obtained from the in-phase and 
quadrature components by using Equations 1 and 2. 

M = (I 2 +Q 2 ) 1/2 (EQ. 1) 
9 = tan 1 (Q/I) (EQ.2) 
Moreover, I and Q components may be obtained from the magnitude and the phase 
components by using Equations 3 and 4. 

I = M cos cp (EQ. 3) 
Q = M sin cp (EQ. 4) 

Additionally, the power of a SAR signal may provide good visual results when printing 
intensity (magnitude-only) imagery. The power of a SAR signal may be obtained from 
Equation 5. 

P = 20 logio M 2 (EQ. 5) 
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[37] The conversion between (I, Q) and (M, q>) as expressed in EQs. 1-4 allows SAR data 202 
to be studied in both data formats before and after compression. When SAR data 202 are 
represented as magnitude and phase components, additional bits may be allocated to the 
phase component versus the magnitude component to achieve the least degradation of the 
phase product, depending on characteristics of SAR data 202. In an embodiment, more 
bits (e.g. six bits) of the phase component and fewer bits (e.g. two bits) of the magnitude 
component are used to generate compressed I and Q components. Conversely, when SAR 
data 202 are represented by in-phase and quadrature components, apparatus 200 can 
process the in-phase component separately from the quadrature component for a single 
complex image. 

[38] Preprocessor 201 also determines a data type (as discussed in the context of Figure 3) and 
informs quantizer 205 through an adaptive control loop 251. 

[39] Figure 3 shows preprocessor apparatus 201 (as shown in Figure 2) for preprocessing 
complex image 202 in accordance with an embodiment of the invention. Preprocessor 
apparatus 201 reduces the number of bits that are needed to represent complex data (I,Q) 
within a specified degradation (corresponding to an error metric). Typically, VPH data 
104 or SLC 1 10 data are represented by (I,Q) data pairs 202, in which each pair uses 64, 
32, or 16 bits, and where I and Q are separately represented in 32, 16, or 8-bit formats, 
respectively. Data 202 may be formatted in which an ordering of the most significant to 
the least significant bytes may be reversed with respect to the assumed order that 
preprocessor 201 processes data 202. In such a case, preprocessor 201 may perform "byte 
swapping" to reorder data 202 in accordance with the assumed ordering of the constituent 
bytes. 

[40] An adaptive source data calculations module 301 separately processes the I and Q 
components of (I,Q) data pairs 202 in order to determine corresponding statistical 
characteristics. (An example of statistical characteristics is shown in Figure 5, in which 
the I component has approximately the same statistical characteristics as the Q 
component.) In the embodiment, a general-purpose computer (e.g. an associated 
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microprocessor) measures the number of occurrences of the I component or the Q 
component as a function of the value of the I component or the Q component. 
Additionally, adaptive source data calculations module 301 performs header analysis by 
reading information provided at the beginning of a data file comprising data 202 in order 
to determine the format of the data being analyzed, e.g. the number of bits that are 
associated with (I,Q) data 202. Module 301 also performs data analysis that provides 
statistical characteristics of data 202 as may be characterized by probability density 
functions of the I component and the Q component (as exemplified by Figure 5). Module 
301 determines a bin assignment that may vary with the value of the I or Q component. In 
the embodiment, a size of a bin is inversely related to a value of the probability density 
function at a midpoint of the bin. A calculations module 303 uses the statistical 
characteristics of data 202 to assign the I and Q components into bins. A module 305 uses 
the bin identity to form the V and Q' components (converted I component and converted 
Q component, corresponding to data 204 in Figure 2), having 8-bit integer values 
between 0 and 255 by efficiently allocating bins, in which most of the bins are assigned 
to a range containing the most data points. For example, data (corresponding to either I or 
Q) may range from -10,000 to +10,000 units, in which over 99.9% of the data are 
contained with a range of -2,000 to +2,000 units. In such a case, most of the bins would 
be allocated between the smaller range (i.e. -2000 to +2,000 units) rather than the larger 
range (i.e. -10,000 to +10,000 units). 

In a variation of the embodiment, Single Look Complex (SLC) data 1 10 are transformed 
using a Fast Fourier Transform (FFT) prior to binning data 202 by modules 303 and 305, 
wherein a transformation of SLC data 1 10 has statistical characteristics that are similar to 
VPH data 104. (In the embodiment, modules 303 and 305 bin data 202 by first processing 
the I component and subsequently processing the Q component.) However, other 
embodiments of the invention may utilize other transform types in order to modify 
statistical characteristics of the data. After quantization by modules 303 and 305, the 
transformed SLC data are inversely transformed using an Inverse Fast Fourier Transform 
(IFFT). 
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[42] Figure 4A shows a process for binning data associated with complex image data 202, as 
performed by module 303 in accordance with an embodiment of the invention. Complex 
image data 202 are separated into I and Q components by a module 403. If the most to 
the least significant bytes need to be reordered, modules 405 and 413 swap bytes for the I 
component and Q component, respectively. Modules 407 and 415 determine the 
probability density functions for the I component and the Q component, respectively over 
data files (comprising static images of a data gathering session). As discussed in the 
context of Figure 5, the probability density functions of the I component and the Q 
component may be essentially the same so that embodiments of the invention may utilize 
one module by separately processing the I and Q components. Modules 409 and 417 bin 
the I component and the Q component, respectively. The greater the probability density 
function p(xj), where x\ is the center value of the i th bin, the smaller the range of the i th bin 
in order to provide better resolution for data within the i th bin. 

[43] Figure 4B shows a process for truncating magnitude and phase components of a complex 
image in accordance with a second embodiment of the invention. In a second 
embodiment of the invention, module 305 of preprocessor apparatus 201 may utilize a 
different number of bits that are associated with the phase component ((p) than is 
associated with the magnitude component (M). In the embodiment, fewer bits from the 
magnitude component (a truncation of M) and more bits from the phase component (a 
truncation of q>), as determined from Equations 1 and 2 by converting I and Q into M and 
(p, are used to generate compressed components F and Q', as determined from Equations 
3 and 4 by converting the truncations of M and (p into V and Q\ Allocating more bits 
from the phase component helps preserve phase information, as may be the case with 
Video Phase History (VPH) data 104. As shown in Figure 4B, complex image data 202 is 
separated into I and Q components by module 453. The I and Q components are 
converted into magnitude and phase components by module 455. Module 457 truncates 
the magnitude and phase components in order to retain a desired number of bits from 
each of the components. Module 459 converts the truncated portions of the magnitude 
and phase components to form compressed components V and Q' (corresponding to data 
461). 
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[44] Apparatus 200 may use the same statistical modeling for the In-phase (I) and Quadrature 
(Q) components if both components have approximately the same statistical 
characteristics. Figure 5 shows probability density functions that are associated with in- 
phase and quadrature components of exemplary synthetic aperture radar data. A number 
of pixels 501 is shown in relation to a corresponding pixel values 503 for a typical SAR 
image. A Probability Density Function (PDF) 507 for the in-phase component and a 
probability density function 505 for the quadrature component are approximately the 
same. Figure 5 suggests that apparatus 200 may process both the in-phase component and 
the quadrature components in the same way without incurring a large error. If probability 
density function 507 is essentially the same as probability density function 505, then one 
may obtain a probability density of one of the components (either PDF 507 or PDF 505) 
and approximate the probability density function of the other component by the obtained 
probability density function. However, other embodiments of the invention may use 
different statistical relationships for the in-phase component and the quadrature 
component if the statistics characteristics differ appreciably. 

[45] Preprocessor 201 accommodates different sensor types regarding a data format and a 
number of bits per pixel. (A pixel corresponds to a point in the corresponding image 
being scanned by a radar system.) SAR data 202 are typically 64 bits (with 32 bits for the 
I component and 32 bits for the Q component for each pixel) or 32 bits (with 16 bits for 
the I component and 16 bits for the Q component for each pixel). Preprocessor 201 
determines the range of pixel values and the best bin assignment. Values of the I and Q 
components are converted to 8-bit formats with more bits being allocated from the 
associated phase component than the magnitude component before reducing the I and Q 
components to 8-bit formats. (As previously discussed, two bits from the magnitude 
component and six bits from the phase component, as determined from Equations 1 and 2 
by converting I and Q into M and cp, are used to generate compressed components V and 
Q', as determined from Equations 3 and 4 by converting the truncations of M and (p into 
I'andQ'.) 
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Figure 6 shows Root Mean Square Error (RMSE) values that are associated with 
magnitude and phase data for processed data (e.g. processed SAR data 204) as shown in 
Figure 2 in accordance with an embodiment of the invention. (The root mean square error 
is a measure of the quantization error by relating the compressed data with the original 
data.) Values 601 are related to an assigned number of bits per pixel 603 for phase data 
605, magnitude data 607 (with a linear-log representation), and magnitude data 609 (no 
linear-log representation). Similarly, calculations may be performed for (I, Q) data. Root 
mean square error and Peak Signal to Noise Ratio (PSNR) figures of merit may be 
initially used as a basis for designing preprocessor 201 and for the evaluating the 
compressed imagery. 

Processed SAR data 204 (comprising a converted I component and a converted Q 
component) are further processed through transform module 203 using a Discrete Cosine 
Transform (DCT) in order to obtain the frequency representation of the in-phase and the 
quadrature data as transformed data 206 (comprising a transformed I component and a 
transformed Q component). As will be discussed in the context of Figure 7, the converted 
I component and the converted Q component of SAR data 204 are separately partitioned 
into smaller blocks. (Each block is essentially independent of other blocks so that each 
block may be processed individually in order to process an entire image.) The discrete 
cosine transform is well known in the art, and is given by Equation 6. 



Nj - 1 N 2 - 1 

1 *-kj 



cos 



2N 2 



(2j ♦ 1) 



(EQ. 6) 



B ( k l'^) = Yi Z 4-A(i.j)-cos ^(21 ♦ 1) 
i = 0 j =0 

In Equation 6, pair (i,j) represents a pixel of processed SAR data 204 within a block 
(which is a portion, A(i j) represents a corresponding in-phase or quadrature value of the 
pixel, and B(k l5 k 2 ) represents a corresponding DCT coefficient, where pair (ki,k 2 ) 
identifies the DCT coefficient in the DCT matrix. In the embodiment, a DCT coefficient 
is calculated over an eight by eight pixel block, i.e. Ni and N 2 equal 8, although other 
embodiments of the invention may use a different value for N. (The collection of DCT 
coefficients may be represented by an 8 by 8 matrix.) 
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[48] Figure 7 shows a partitioning of complex image data in order to obtain Discrete Cosine 
Transform (DCT) data in accordance with an embodiment of the invention. In the 
embodiment, SAR data 202 comprise the I component and the Q component, each 
component corresponding to a large (such as 1024 by 1024) data file 701. Transform 
module 203 partitions each file 701 into a square (such as a 8 by 8 block for the DCT 
matrix), e.g. blocks 703 and 705. Transform module 203 processes each block (e.g. 703 
and 705) in accordance with Equation 6. In order to process the entire data file 701, 
preprocessor 201 processes 128 partitions for both the I component and the Q component. 

[49] Figure 8 shows apparatus 205 for quantizing Discrete Cosine Transform (DCT) data in 
accordance with an embodiment of the invention. Quantizer 205 comprises an adaptive 
table generation module 801, an adaptive table selection module 803, and a 
perform_data_quantization module 805. Adaptive table generation module 801 generates 
a new quantization conversion table (which contains a quantization matrix that is used for 
further data compression as will be explained) for a new data type and stores the new 
quantization conversion table into a knowledge database 807 through an interface 809 
when functioning in a training mode but not during an operational mode. During the 
operational mode, transformed data 206 are processed by adaptive table selection module 
803 and perform_data_quantization module 805. Depending upon the data type, as 
identified by adaptive control loop 251 from preprocessor 201, adaptive table selection 
module 803 selects an appropriate quantization conversion table, which comprises an 8 
by 8 quantization matrix, from knowledge database 807 through an interface 811. If 
adaptive table selection module 803 cannot identify an appropriate quantization 
conversion table from adaptive control loop 251, module 803 selects a default 
quantization conversion table. A quantization conversion table may correspond to 
different data types that are dependent upon factors including the type of radar, 
processing platform (which may affect the number of bits associated with SAR data 202), 
and topography that is associated with SAR data 202. 

[50] Each element of a DCT matrix (e.g. matrix 703) is arithmetically divided by a 
corresponding element of the quantization matrix and rounded to an integer, thus 
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providing quantized DCT data 208 (comprising a quantized I transform or a quantized Q 
transform). Each element of the quantization matrix is determined by statistics for the 
corresponding DCT coefficient in accordance with a specified maximum error (e.g. a root 
mean square error, a peak signal to noise ratio, and a byte by byte file comparison). 
(Figures 9 and 10 show statistics for the (1,1) and the (7,7) DCT coefficients, 
respectively.) The larger the value of an element of the quantization matrix, the greater 
the corresponding step size (with less resolution). However, dividing an element of the 
DCT matrix by a larger number reduces the quantized value. If the quantized value is 
sufficiently reduced, the resulting value may be considered as being zero by encoder 207 
if a specified maximum error (e.g. the root mean square error) is satisfied. 

[51] In a variation of the embodiment, the quantization matrix may be determined by reducing 
a Measurement and Signature Intelligence (MASINT) product distortion. (In some cases, 
the reduction may correspond to a minimization of the distortion.) The distortion may be 
determined from interferometric SAR, coherent change detection (CCD), and polarimetry 
products. Interferometric SAR (IFSAR) is a comparison of two or more coherent SAR 
images collected at slightly different geometries. The process extracts phase differences 
caused by changes in elevation within the scene. IFSAR produces digital terrain 
elevation data suitable for use in providing terrain visualization products. (Products are 
generally referred as Digital Elevation Models (DEM).) These products are used in 
mapping and terrain visualization products. The advantage of IFSAR height 
determination is that is much more accurate than other methods, such as 
photo/radargrammetry methods that use only the intensity (magnitude) data, because 
phase is used and height determination is done with wavelength measurements which are 
very accurate (i.e. for commercial systems at C Band (5 GHz) approximately 5.3 cm)). 

[52] Coherent Change Detection (CCD) is a technique involving the collection and 
comparison of a registered pair of coherent SAR images from approximately the same 
geometry collected at two different times (before and after an event). The phase 
information, not the magnitude, is used to determine what has changed between the first 
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and second collection. This can determine scene changes to the order of a wavelength 
(5.3 cm) and may denote ground changes/activity occurring between collections. 

[53] Polarimetry products are generally collected using systems that can independently radiate 
and collect vertical and horizontal complex SAR data. This technique is accomplished by 
alternately radiating vertical and horizontally polarized SAR pulses, receiving on both 
horizontal and vertical antennas, and saving the complex data from each. The product 
formed is a unique target signature for objects with an associated complex polarized radar 
reflectance. This technique is used in many automatic target recognition systems (ATR). 

[54] In a variation of the embodiment, each member of the quantization matrix (associated 
with a quantization conversion table) is determined by a heuristic process 1 100 as shown 
in Figure 1 1 . A quantization matrix for SAR data 202 may be determined by selecting an 
element of the quantization matrix in step 1103 and perturbing the value of the selected 
element in step 1 105. In step 1 105, the selected element is incremented and decremented 
by incremental values. In step 1 107, root means square errors (RSME) are calculated for 
different compression ratios. The selected value of the selected element is the value 
corresponding to a minimal root mean square error. If there are more elements in the 
quantization matrix to be processed, as determined in step 1 109, the element indices (i,j) 
are incremented in step 1 1 1 1, and the next element is selected in step 1 103. Steps 1 105 
and 1 107 are repeated for the next element. The calculation of the quantization matrix is 
completed after all the elements are processed. 

[55] In another variation of the embodiment, the quantization matrix is determined by the 
statistical characteristics of the DCT matrix, as was previously discussed. The 
quantization matrix is subsequently modified according to heuristic process 1 100. 

[56] Transformed data 206 are quantized according to corresponding transform statistics that 
are associated with the DCT coefficients. DCT coefficients can be represented as 
departures from a standard statistical distribution function (e.g., Laplacian, Gaussian, or 
Rayleigh). (A Laplacian function has a form of e-M, while a Gaussian function has a form 
of e- x2 .) Figure 9 shows a representative histogram for a low order Discrete Cosine 
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Transform (DCT) coefficient, DCT coefficient (1,1), in accordance with an embodiment 
of the invention. A number of observations 901 is shown in relation to corresponding bin 
values 903. Actual data 905 is shown along with a Laplacian relation 907 and a Gaussian 
relation 909. Also, Figure 10 shows a representative histogram for a high order Discrete 
Cosine Transform (DCT) coefficient, DCT coefficient (7,7), in accordance with an 
embodiment of the invention. A number of observations 1001 is shown in relation to 
corresponding bin values 1003. Actual data 1005 is shown along with a Laplacian 
relation 1007 and a Gaussian relation 1009. Analysis of the exemplary SAR data reveals 
a relationship with respect to the low order and high order DCT coefficients. By plotting 
the Laplacian and Gaussian functions and comparing the corresponding values with the 
DCT coefficient data of the exemplary SAR data, it is determined that low order terms 
can be better represented by the Laplacian function, and the higher order terms can be 
better represented by the Gaussian function for typical SAR data. Quantization by 
quantizer 205 is designed by accounting for the complex SAR image DCT statistics as 
exemplified by Figures 9 and 10. As the probability distribution becomes more focused 
about a zero value for a DCT coefficient, the less is the relative significance of the DCT 
coefficient with respect to other DCT coefficients. Consequently, the corresponding 
entry in the quantization conversion table may be greater for the DCT coefficient. 

[57] Other embodiments of the invention may utilize other transform types such as a Discrete 
Fourier Transform (DFT) or a discrete z-transform, both transforms being well known in 
the art. However, with a selection of a different transform, the transform statistics may be 
different as reflected by the design of quantizer 205. 

[58] Quantized SAR data 208 are consequently processed by encoder 207 (e.g. a Huffman 
encoder). Each output 210 (comprising a compressed I component and a compressed Q 
component) of encoder 207 comprises an encoder pair (comprising a number of zeros 
that precede output 210 and a number of bits that represent a value of the corresponding 
DCT coefficient) and the value of the corresponding DCT coefficient (SAR data 208). 
Encoder 207 may provide additional compression by removing a degree of redundancy 
that is associated with the encoder pair and SAR data 208 (in which frequently occurring 
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data strings that are associated with the quantized DCT coefficients are replaced with 
shorter codes). Other embodiments of the invention may utilize other types of encoders 
such as Shannon Fano coding and Arithmetic coding. Encoder 207 provides encoded data 
210 to post-processor 209. 

[59] Post-processor 209 may further process encoded data 210 in order to format data 210 into 
a format that is. required for storing (that may be associated with archiving compressed 
data) or for transmitting compressed data 212 through a communications device. In the 
embodiment, the communications device may be a radio frequency transmitter that 
transmits from a plane to a monitoring station, utilizing a radio data protocol as is known 
in the art. In the embodiment, for example, post-processor 209 may format a data file 
(corresponding to a SAR image) into records that can be accommodated by a storage 
device. Also, post-processor may include statistical information and the data type 
regarding SAR data 202. The statistical information and the data type may be used for 
decompressing compressed SAR data 212 at a subsequent time. 

[60] Compressed data 212 may be subsequently decompressed by using apparatus that utilizes 
inverse operations corresponding to the operations that are provided by apparatus 200 in 
a reverse order. Figure 12 shows an apparatus 1200 for decompressing compressed data 
1212 (that was compressed by apparatus 200 as shown in Figure 2) into a decompressed 
data 1202 in accordance with an embodiment of the invention. (Decompressed data 1202 
approximates data 202 within a specified maximum error.) An inverse post-processor 
1209, a decoder 1 107, an inverse quantizer 1205, an inverse transform module 1203, and 
an inverse preprocessor 1201 correspond to post-processor 209, encoder 207, quantizer 
205, transform module 203, and preprocessor 201, respectively. However, an inverse 
operation may not be able to exactly recover data because of quantization restraints. For 
example, quantizer 203 divides a DCT coefficient by a corresponding element in the 
quantization matrix (which is obtained from a quantization conversion table selected by 
module 803 from knowledge database 807) and rounded to an integer. The operation of 
rounding to an integer may cause information about the DCT coefficient to be lost. 
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Consequently, the lost information cannot be recovered by inverse quantizer 1205 in 
determining the DCT coefficient. 

[61] In the embodiment, compressed data 212 may be compliant with National Imagery 
Transmission Format (NITF) standards, in which header information about user-defined 
data (e.g. a quantization matrix) may be included. Thus, compressed data 212 may be 
compatible with processing software in accordance with Joint Photographic Experts 
Group (JPEG) compression standards. 

[62] Other embodiments of the invention may compress and decompress data that are 
characterized by a different number of components (often referred as dimensions). Data 
that is characterized by more than one component (e.g. 2, 3, or more components) are 
often referred as multidimensional data. In such cases, preprocessor 201 may determine 
statistical characteristics associated with each of the components and map each of the 
components to bins in accordance with the statistical characteristics. Transform module 
203 transforms each of the components according to a selected transform (e.g. a Fast 
Fourier Transform). Quantizer 205 subsequently quantizes each of the transformed 
components. 

[63] Classical Electro-Optical (EO) based metrics, such as root mean square error (RMSE) 
and Peak Signal to Noise Ratio (PSNR), are useful for evaluating the magnitude imagery, 
but the EO-based metrics may not provide sufficient information about the phase data or 
the other derived products. EO-based metrics provide a necessary but not a sufficient 
condition for complex data compression fidelity. Useful magnitude imagery may also be 
available from the compression process. The processes that generate phase data driven 
products such as interferometry, CCD and polarimetry may be included in the 
evaluations. Additional SAR data product metrics may be implemented to evaluate the 
phase information and any degradation of the products caused by compression. 

[64] An evaluation of compressed exemplary SAR data as processed by apparatus 200 
indicates that, with SAR data 202 being compressed at ratios greater than twenty to one, 



-19- 



Attorney Docket No. 000479.00127 



apparatus 200 may achieve near-lossless results for magnitude images and minimal 
degradation to phase information. 

Detailed Description of the Invention (Second-Generation Embodiments) 
Processing Interleaved Components 
[65] Figure 13 shows an architecture 1300 for processing synthetic aperture radar data 202 in 
which components are split in accordance with an embodiment of the invention. Data 202 
comprises a received I component and a received Q component that are interleaved. 
Figure 14 shows a data stream 1400 that transports complex SAR data 202. Data stream 
1400 interleaves received I component samples (samples 1401, 1405, 1409, and 1413) 
with corresponding received Q component samples (samples 1403, 1407, 1411, and 
1415). 

[66] Referring to Figure 3, as previously discussed, adaptive source data calculations module 
301 splits (separates) the received I component from the received Q component before 
further processing SAR data 202. With architecture 1300, the splitting of I and Q 
components is functionally associated with module 403 (as shown in Figure 4A). As 
shown in architecture 1300, the I component and the Q component are separately 
processed for compressing and decompressing SAR data 202. 

[67] Figure 15 shows splitting data stream 1400 into I component 1551 and Q component 
1553. I component 1551 comprises I component samples 1501, 1503, 1505, and 1507, 
and Q component 1553 comprises Q component samples 1509, 1511, 1513, and 1515. 

[68] Referring to Figure 13, modules 1301 and 1303 process (compress and decompress) the I 
component, and modules 1305 and 1307 process the Q component. In the embodiment, I 
component data and Q component data are transferred by modules 1302 and 1306, 
respectively. (As examples, data may be transferred through file transfers, data tape 
transfers or radio transmission transfers.) The processed data is rendered by module 1309. 
Architecture 1300 is incorporated into the apparatus as previously discussed in Figure 3. 
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[69] Figure 16 illustrates a second architecture 1600 for processing synthetic aperture data 202 
in which components are interleaved in accordance with an embodiment of the invention. 
With architecture 1600, interleaved I and Q component samples (for example as shown in 
Figure 14) are processed by compress interleaved data module 1601 and decompress 
interleaved data module 1603. In the embodiment, interleaved data are transferred by 
module 1602. (As examples, interleaved data may be transferred through file transfers, 
data tape transfers or radio transmission transfers.) After processing by modules 1601 and 
1603, I data 1607 is split from Q data 1609 by module 1605. Processed data (data 1607 
and data 1609) is rendered by module 1611. 

[70] In the embodiment, modules 1601 and 1603 processes interleaved data, where the I 
component and the Q component have approximately the same statistical characteristics. 
Typically, the resulting compression ratio decreases the more that the statistical 
characteristics of the I component differ from those of the Q component. 

Determination of Data Type 
[71] Figure 17 shows an apparatus 1700 that is a variation of apparatus 800 as shown in 
Figure 8. As shown in Figure 17, preprocessor 1701 corresponds to preprocessor 801, 
transform module 1703 corresponds to module 203, modified quantizer module 1705 
corresponds to quantizer 205, encoder module 1707 corresponds to encoder 207, 
knowledge base 1711 corresponds to knowledge base 807, interface 1713 corresponds to 
interface 811, and adaptive control loop 1751 corresponds to adaptive control loop 251 in 
relation to Figure 8. Apparatus 1700 also includes training mode feedback 1753 and 
metadata output 1755, which will be discussed. 

[72] As with adaptive control loop 251 as shown in Figure 8, preprocessor 201 (as shown in 
Figure 17) provides identification information about the data type for SAR data 202 to 
modified quantizer module 1705 through adaptive control loop 1751. In the embodiment, 
preprocessor 201 provides metadata, e.g., mean, standard deviation, maximum data 
value, and minimum data value, from which modified quantizer module 1705 can 
identify the data type and retrieve the appropriate quantization conversion table from 
knowledge base 1711. 
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[73] If module 1705 cannot identify the data type from the metadata, module 1705 selects a 
default quantization table and uses the default quantization table from knowledge base 
1711 as similarly explained in the context of Figure 8. Moreover, modified quantizer 
module 1705 may notify preprocessor 1701, through training mode feedback loop 1753, 
that a data type cannot be identified using the provided metadata. Preprocessor 1701 may 
consequently specify a new quantization table corresponding to the metadata. 

[74] After quantizing the data, encoder module 1707 encodes the data, as previously explained 
with Figure 8, and passes the processed data to module 1709. Additionally, preprocessor 
1701 provides the metadata to module 1709 (through metadata output 1755) so that the 
processed data can be decompressed in accordance with the corresponding data type. 

[75] Figure 18 shows a flow diagram 1800 for determining the data type from SAR data 202 
in accordance with an embodiment of the invention. In the embodiment, flow diagram 
1800 is implemented with preprocessor 1701 and modified quantizer module 1705, 
although alternative embodiments may implement flow diagram 1800 entirely within 
module 1701 or module 1705 or another module or may implement flow diagram 1800 
by distributing the functionality across a plurality of modules. 

[76] Step 1801 performs header analysis if header information is included with SAR data 202 
by reading information at the beginning of a data file that identifies the format of the data 
being analyzed. (The operation of step 1801 is similar to the header analysis performed 
by adaptive source data calculations module 301 previously explained with Figure 3.) 
Step 1803 parses the header information and the data type is identified in step 1821. 

[77] If header data is not available, SAR data 202 is analyzed in order to deduce the metadata. 
In step 1805, the number of bits per data word is determined. If the order of bytes is 
reversed with respect to the assumed order that preprocessor 201 uses for processing 
SAR data 202, as determined by step 1807, the bytes are swapped in step 1809. 
(Operation of step 1807 and 1809 are similar to the operation as performed by 
preprocessor 201 as shown in Figure 3.) 
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[78] In step 1811, the maximum value and the minimum value of SAR data 202 are 
determined. Furthermore, the mean and the standard deviation of SAR data 202 are 
calculated in step 1813. The metadata (comprising the minimum value, the maximum 
data, the mean, and the standard deviation) are compared to corresponding metadata of 
known data types in step 1815. In step 1817, if the data type is known, the data type is 
identified in step 1821. Otherwise, the data type is assumed to be the default data type in 
step 1819. 

[79] As can be appreciated by one skilled in the art, a computer system with an associated 
computer-readable medium containing instructions for controlling the computer system 
can be utilized to implement the exemplary embodiments that are disclosed herein. The 
computer system may include at least one computer such as a microprocessor, digital 
signal processor, and associated peripheral electronic circuitry. 
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